Inferring Cognitive States from Multimodal Measures in Information Science
نویسندگان
چکیده
This paper presents our work using uniand multi-modal measures to infer and predict context and mental states of a person engaged in interactive information seeking. We describe our use of measures derived from eye-movement patterns in combination with interaction logs to infer dynamic user states (such as cognitive load), user context (such as task characteristics), and persistent user characteristics (such as domain knowledge). We briefly present on-going projects that add further psychophysiological signals, such as electro-encephalography (EEG) and galvanic skin response (GSR).
منابع مشابه
PROspective MOtion Correction (PROMO) Results in Improved Image and Segmentation Quality of High-Resolution MRI Scans of Children
J. M. Kuperman, T. T. Brown, M. J. Erhart, J. C. Roddey, N. C. White, A. Shankaranarayanan, E. T. Han, D. Rettmann, and A. M. Dale Radiology, UCSD, La Jolla, CA, United States, Multimodal Imaging Lab, UCSD, La Jolla, CA, United States, Neurosciences, UCSD, La Jolla, CA, United States, Cognitive Science, UCSD, La Jolla, CA, United States, Applied Science Lab, GE Healthcare, Menlo Park, CA, Unite...
متن کاملPublic Transport Ontology for Passenger Information Retrieval
Passenger information aims at improving the user-friendliness of public transport systems while influencing passenger route choices to satisfy transit user’s travel requirements. The integration of transit information from multiple agencies is a major challenge in implementation of multi-modal passenger information systems. The problem of information sharing is further compounded by the multi-l...
متن کاملMultimodal trust formation with Uninformed Cognitive Maps (UnCM)
This work describes a cognitive heuristic allowing agents to assess trust and delegations merging heterogenous information sources. The model is realized through Uninformed Cognitive Maps, based on the combination of: (i) categorization abilities (ii) history of personal experiences (iii) context awareness.
متن کاملOn designing comprehensible interactive hypermedia manuals
User’s mental representations and cognitive strategies can have a profound influence on how they interact with computer interfaces (Janosky, Smith & Hildreth, 1986). However, there is very little research that elucidates such mental representations and strategies in the context of interactive hypermedia. Furthermore, interface design for hypermedia information presentation systems is rarely dri...
متن کاملMultimodality Inferring of Human Cognitive States Based on Integration of Neuro-Fuzzy Network and Information Fusion Techniques
To achieve an effective and safe operation on the machine system where the human interacts with the machine mutually, there is a need for the machine to understand the human state, especially cognitive state, when the human’s operation task demands an intensive cognitive activity. Due to a well-known fact with the human being, a highly uncertain cognitive state and behavior as well as expressio...
متن کامل